Dynamic Light Field Reconstruction and Rendering for Multiple Moving Objects

Light fie ld re c o n stru c tio n is still m o stly lim ite d to sta tic sc e n e s o r is o n ly a p p lic a b le to d y n a m ic sc e n e s u sin g so p histic a te d a n d c o stly ha rd w a re . In c o n tra st to tha t, o u r c o n trib u tio n d e sc rib e s a sy ste m w hich a llo w s the re c o n stru c tio n o f a light fie ld o f a sc e n e in c lu d in g o n e o r m o re rigid ly m o v in g o b je c ts u sin g o n ly o n e ha n d -he ld c a m e ra . B y se p a ra tin g a u to m a tic a lly tra ck e d fe a tu re p o in ts in to d iffe re n t o b je c ts, stru c tu re -fro m -m o tio n a lgo rithm s c a n b e a p p lie d fo r e a ch o b je c t. T he ex te n sio n to lo n g im a ge se q u e n c e s is d o n e ite ra tiv e ly a n d the d y n a m ic light fie ld is c re a te d b y m e rgin g the in d iv id u a l re c o n stru c tio n s a n d q u a n tizin g the o b je c t p o se s in to d istin c t tim e ste p s. F o r re n d e rin g p u rp o se s, a n ex te n sio n o f the U n stru c tu re d Lu m igra p h is in tro d u c e d w hich u se s c o n fid e n c e m a p s to m a rk sc e n e b a ckgro u n d , v isib le a n d in v isib le o b je c t p o se s.